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SUMMARY 


This  report  describes  progress  made  in  the  development  of  a  network- 
oriented  system  for  teleconferencing.  The  program  is  called  FORUM.  Ikjst 
of  the  preliminary  softv;aro  tests  have  now  been  completed.  The  current 
version  (Release  4)  follov/s  the  specifications  given  in  the  previous  semi¬ 
annual  report,  of  which  the  general  systems  features  of  the  Programmer's, 
Chairman's,  and  Respondent's  Guides  are  still  applicable. 

The  present  document  addresses  itself  more  specifically  to  a  review 
of  practical  e^gierience  in  the  use  of  FORUM  both  at  the  Institute  and 
within  the  ARPANET  community.  It  is  divided  into  three  sections  describing 
(1)  the  current  program  status;  (2)  user  experience  to  date;  and  (3)  imple¬ 
mentation  plans  beyond  Release  4.  An  analysis  of  user  reaction  at  USC-ISI 
is  described  in  the  .second  section  of  the  report,  with  background  data  as 
a  special  appendix  to  the  report. 
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I .  PROJECT  ACCOMPLISHMENTS 


This  is  the  tiiird  Semiannual  Technical  Report  describing  work  in 
progress  on  a  two-vear  project  concerned  with  the  development  of  a  computer 
conferencing  network.  Initially  thought  of  as  a  "policy- formulation" 
system,  the  softvjace  we  are  implementing  has  now  evolved  to  the  point  where 
it  smoothly  supports  other  aspects  of  management  interaction . 


ReX<^se  4  of  FORUM  is  now  resident  on  the  POP-IO  computer  at  both 
USC-ISI  iihd  BBN  as  a  working  program.  A  major  difference  between  Release 
4  and  the  previous  version,  which  was  described  in  full  detail  in  the 
second  Semiannual  T(5chnical  Report,  is  the  fact  that  the  file  system  is 
now  fully  paged.  FORUM-4  is  re-entrant  and  operates  well  interactively 
even  during  periods  of  very  heavy  usage  of  the  compvxter. 

From  a  user's  viewpoint,  several  major  changes  have  taken  place  since 
Release  3.  It  is  now  possible  for  an  individual  participant  to  gain  a 
rapid  view  of  all  conferences  in  the  system,  both  those  in  w'hich  he  is  a 
registered  member  and  those  which  he  may  join  as  a  guest.  Within  a  given 
discussion,  he  can  interact  in  real  time  with  all  active  participants  in 
the  group;  he  can  sulamit  anonymous  entries,  send  private  messages,  and 
follow  changes  in  participant  status.  The  numbering  of  entries  provides 
an  easy  reference  tc  previous  comments  in  the  discussion. 

Considerable  progress  has  been  made  in  developing  software  to  support 
a  variety  of  CRT  teiminals;  automatic  pagination,  scrolling,  and  cursor 
control  in  line  editing  are  among  the  support  features. 

Release  4  follc>ws  the  plan  described  in  the  previous  Semicinnual  Tech¬ 
nical  Report.  It  contains  the  command  language  outlined  in  both  the  Chair¬ 
man's  and  Respondent's  Guides.  Progress  has  been  made,  however,  toward 
the  integration  of  the  command  language  within  the  conference  structure  . 
rather  than  as  a  separate  mode.  This  concept,  which  places  the  full 
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resoTurces  of  the  system  at  the  disposal  of  the  expert  participant  without 
forcing  him  to  leave  an  on-line  discussion  even  briefly,  is  described  in 
more  detail  in  Section  II. 


A  THEORETICAL  FRAMEWORK 

The  analysis  of  the  conference  process  under  a  computer  system  requires 
a  formal  description  of  several  operating  modes  that  are  not  identified  as 
such  in  face-to-face  discussion.  In  this  section  of  the  report  we  propose 
a  characterization  of  the  concept  of  conference  structure  and  ask  the 
following  questions:  How  many  parameters  are  required  for  the  description 
of  these  various  operating  modes  (or  states) ?  Can  a  formalism  be  developed 
to  show  how  these  modes  are  related  and  what  transitions  are  possible  be¬ 
tween  them? 

For  the  purpose  of  answering  these  questions  it  is  of  interest  to  con¬ 
sider  a  system  such  as  FORUM  as  a  finite-state  machine.  Given  a  set  of 
N  participants, 

(P^)  i  =  1  to  N 

Pj^  being  the  Chairman,  we  find  that  a  FORUM  conference  can  be  characterized 
by  the  question:  At  a  given  instant,  which  participant  may  i. ake  an  entry, 
on  which  topic,  and  in  what  format;  and  to  whom  can  the  entry  be  directed? 
This  question  leads  to  definitions  of  five  parameters; 

w  the  value  of  i  such  that  P^  can  originate  an  entry 

6  the  value  of  i  such  that  P^  can  receive  the  entry 

9  the  topic  that  the  en:ry  can  address 

<|i  the  format  of  the  entry 

p  the  number  of  active  participants 
These  parameters  can  take  the  values  listed  in  Table  1. 


State  Parameter 


Range  of  Values 


0! 

1  to  N 

6 

0  =  system 

1  =  chai rmon 

2  =  user 

3  “  subgroup 

4  =  whole  group 

0 

F  (free) 

S  (specific) 

C  (command) 

<{• 

D  (discussion) 

R  (restricted) 
c  (command) 

V 

1  to  N 

TAB'E  ! 


The  ten  states  into  which  the  FORUM  progrexm  can  currently  be  placed 
are  as  follows: 

Sq  setup 

s^  feedback  questionnaire 

s^  asynchronous  directed 

s^  as;ynchronous  free 

s^  synchronous  directed 

Sg  synchronous  free 

s.  whisper  mode 
6 

s^  anonymous  mode 

s  whisper  to  FORUM 
6 

Sg  whi spier  to  EXEC 
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Because  the  previous  report  described  a  program  that  exhibited  a  much 
more  restricted  range  of  possible  states  (mainly  s^  and  s^^) ,  it  is  necessary 
to  briefly  describe  the  nevf  features  we  have  introduced  before  j^roceeding 
with  this  model.  ^ 

The  concept  of  the  FORUM  whisper  mode  is  an  innovation  in  a  system  of 
this  kind.  By  simply  typing  a  left  parenthesis,  any  conference  participcint 
can  initiate  the  sending  of  a  private  message  to  another  participant.  The 
system  prompts  the  user  for  the  destination  of  the  mes:;age  and  then  provides 
a  right  parenthesis;  it  also  prompts  for  the  text  itself.  The  user's 
terminal  listing  will  show  the  entry  as: 

(to  Smith) 

-  Should  we  remind  the  chairman  of 

-  the  change  we  suggested  in  the  agenda? 

We  have  extended  this  concept  to  the  case  in  which  a  user  requires  a 
special  service  from  the  program  itself.  A  typical  example  of  such  a 
situation  would  be  a  request  for  status  display.  To  avoid  the  need  for  the 
participant  to  hit  the  ESCAPE  key  and  go  to  the  command  language  level,  we 
make  the  system  accept  its  own  name  as  the  recipient  of  a  private  message. 
Within  a  conference  discussion,  it  becomes  possible  tc  say: 

(to  FORUM) 

-  status  of  participants 


This  same  concept  also  applies  to  the.  case  in  which  a  participant 
wis)ies  to  use  the  resources  of  the  executive  (in  the  present  case,  TENEX 
system) .  The  message  would  appear  as  follows; 

(to  EXEC) 

ISI-TENEX 
@  NETSTAT 


C-iven  these  definitions  and  the  parameter  values  defined  above,  the 
states  of  FCRCJH  can  be  characterized  by  the  matrix  in  Table  2.  The  simpli 
fied  state  diagram  in  this  matrix  corresponds  ro  Figure  1. 


TABLE  2 

PARALLEL  iOTCE  Cl PCU."  : 

Our  previous  scmia  inual  report  mentioned  th'  t:  voice  coivjT!unication  was 
under  investigation  as  a  possible  adjunct  to  fovijutar  conferencing.  We 
see  this  as  useful  in  two  major  respects;  for  training  of  new  users  and 
for  recovery  instructions.  In  addition,  we  contemplate  using  the  voice 
channel  in  the  adminisr ration  of  intorview.s  during  some  formal  experiments 

The  design  of  an  experimental  system  along  these  lines  (based  upon 
"Model  5"  ir  the  special  Institute  report,  Voico-Confc~cncj ng  Arrangement 
for  an  On-Line  Interrogation  System,  by  Paul  Baran)  is  now  completed. 

We  will  soon  have  a  voice  conferencing  arrangement  w’ th  thirty- two 
voice  lin  s  and  six  simultaneous  conferencing  circuits.  It  v/ill  have  the 


ASYNCHRONOUS 

DISCUSSION 

MOOES 


SYNCHRONOUS 

DISCUSSION 

MODES 


status,  review 
mode,  etc. 


lower- level 
fork 


FIGURE  I 
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^d)ility  to  place  lines  in  the  following  states: 

•  Monitor  only 

•  Talk  and  monitor 

•  Talk  only  (can  be  used  for  general  broadcast,  in  >;hich  case  a  line 
may  be  connected  to  all  conference  paths) 

A  connector  will  be  supplied  to  the  system  for  external  ccnnection  to 
a  generii  purpose  conouter.  The  design  of  the  system  shall  allow  the  MCS 
and/or  the  general  purpose  machine  to  control  the  system. 

The  switching  technology  will  be  analog,  ai;. hough  we  may,  during  the 
design  and  development,  go  to  digital.  In  any  case,  care  will  be  taken  to 
allow  for  upgrading  of  the  switch  to  handle  digital  trw.ffic  if  necessary. 

The  initial  design  will  not  support  Touch-Tone  from  the  telephones 
for  system  control.  We  will  look  at  this  problem  and  attempt  to  add  the 
feature,  or  at  least  lay  the  groundwork  for  adding  the  feature. 

A  telephone  modification  will  be  engineered  to  allow  the  system  to 
detect  hang-ups,  etc.  without  special  tr>uik  circuits. 

We  will  examine  the  possibility  of  supplying  auto-dia].,  but  will  not 
incorporate  it  into  the  Model  1  system. 

The  system,  which  is  currently  being  '^uilt  vinder  a  subcontract  with 
Dr.  David  Farber  of  the  University  of  California  at  Irvine,  is  depicted 
in  Figure  2. 

FORUM  LABORATORY 

The  facilities  available  at  the  Institute  for  the  development  and 
testing  of  FORUM  have  been  expanded  from  four  to  eight  leased  terminals. 
One  of  these  is  a  Terminet  printer,  and  another  is  a  CRT  display  which 
operates  at  the  1200  baud  rate  (this  has  been  made  po.'slLit:  by  Hardware 
improvements  at  the  N/VSA/Ames  TIP)  .  Two  more  CRT  displays  have  be,:i 
ordered  for  use  in  connection  with  the  software  monitor  w. "ch  we  are  de¬ 
signing  (see  Section  III  of  this  report) . 

Additional  floor  space  has  been  made  available  to  the  FORUM  project, 
with  the  allocation  of  a  three-room  complex  as  laboratory.  One  of  these 
rooms  is  used  by  the  conference  chairman,  and  a  second  one  by  the  voice 
controller;  the  third  one  serves  as  a  meeting  room  and  terminal  station.' 
The  controller  uses  a  Texas  Instruments  terminal  with  tape  cassettes;  we 
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have  found  this  device  extremely  useful  in  archiving  conference  text  in 
tape  form. 

In  anticipation  of  the  addition  of  the  equipment  described  above >  we 
have  installed  ten  telephone  lines  on  a  rotary  switch  with  an  auto-dialer 
to  permit  the  holding  of  conference  calls.  Headsets  and  speakerphones  are 
used  in  this  configuration  so  that  participants  may  be  free  to  work  at  the 
terminal  while  speaking.  In  this  design  the  chaiman  and  the  controller 
will  be  linked  by  a  special  intercom  (see  Figure  3) . 


I 


PHONE 


DIALER 


HEADSET 


IN-HOUSE 


FIGURE  3.  FORt/M  LABORATORY 


II.  USER  EXPERIENCE 


The  FORUII  system  is  now  at  a  stage  of  development  where  user  experience 
can  be  reviewed  and  analyzed.  At  this  point  the  three  main  sources  of  user 
information  are  in-house  applications,  collaborative  experiments,  and  the 
G-week  experience  of  the  Automatic  Programming  Group  at  ISI. 

FORVM  APPLICATIONS  AT  THE  INSTITUTE 

Figure  4  shoe's  the  current  trends  in  the  use  of  FORUM  by  the  Institute. 

It  reflects  neither  the  conferences  which  were  set  up  for  the  testing  of  FORUM 
nor  those  which  are  used  in  training  new  users.  We  have  established  procedures 
for  bolding  both  synchronous  and  asynchronous  discussions  over  FORUM  on  the 
following  subjects: 

•  Staff  meeting.  An  on-going  discussion  of  our  activities  and  goals 

•  Experiments  design.  A  collective  note  pad  for  tlie  definition  and 
criticism  of  planned  experiments  and  the  review  of  on-going  appli¬ 
cations 

•  Education.  A  discussion  of  the  applicability  of  computer  conferencing 
in  training  and  education 

In  addition,  we  have  .set  up  a  conference  that  is  available  to  all  ARPANET 
users  who  wish  to  express  opinions  on  or  reactions  to  FORUM.  This  conference 
is  quite  heavily  used  and  an  effort  has  been  made  to  respond  to  all  suggestions. 

Although  an  evaluation  of  FORUM  impact  on  our  work  patterns  would  be  pre¬ 
mature,  it  is  already  apparent  that  the  medium  makes  it  possible  to  spend 
less  time  in  meetings  and  to  remain  better  informed  of  project  developments. 

The  availability  of  an  accurate  permanent  record  as  a  reference  for  future 
discussions  is  invaluable  in  a  management  sense. 

COLLABORATIVE  EXPERIMENTS 

We  have  had  an  opportunity  to  conduct  joint  experiments  with  other  organi¬ 
zations  interested  in  computer  conferencing.  Among  these  organizations  are 
the  U.  S.  Geological  Suir/ey  and  Bell  Northern  Research.  In  both  cases  we 
have  created  conferences  under  FORUM  to  provide  a  link  among  participants. 


EDUCATION 
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The  collaboration  with  the  U.  S.  Geological  Survey  led  to  a  series  of  ccin- 
puter  sessions,  lasting  from  one  to  tv;o  hours  and  involving  a  test  of  data¬ 
base  retrieval  through  information  systems  availcible  to  the  users  outside 
the  ARPANET.  This  particular  test  denonstrated  to  us  the  potential  of  an 
approach  where  data-base  software  would  be  interfaced  to  couputer  conferencing. 
This  collaborative  program  involving  other  organizations  will  be  es^anded  to 
the  point  where  a  significant  spectrum  of  user  es^erience  will  be  available. 
Conclusions  will  then  be  drawn  concerning  the  possible  extension  of  the  range 
of  conferencing  styles  available  under  FORUM. 

We  feel  that  our  most  significant  collaborative  effort  in  this  period 
has  been  conducted  with  the  Automatic  Programming  Group  at  USC-ISI.  It  has 
been  reviewed  In  detail  and  our  conclusions  follow. 

EXPERIENCE  IN  THE  ISI  AUTOMATIC  PROGRAMMING  GROUP 

The  Automatic  Programming  Group  at  the  Information  Science  Institute  (ISI) 
of  University  of  Southern  California  wanted  to  hold  asynchronous  conference 
sessions  in  order  to  facilitate  communications  within  the  project.  This  was 
the  first  group  to  use  FORUM  seriously  and  we  appreciate  their  patience  and 
willingness  to  experiment  with  a  developing  communications  medium. 

Strategy  for  FORUM  usage 

During  July  and  August  of  1973,  FORUM  was  used  as  one  medium  of  communi¬ 
cation  for  the  Automatic  Programming  Group  at  131.  The  research  being  done 
during  this  period  involved  advanced  work  in  the  area  of  automatic  conputer 
programming.  The  style  of  FORUM  usage  which  dev-^ loped  focused  on  its  ability 
to  serve  as  a  kind  of  collective  note  pad  for  the  research  team.  In  thir 
application,  then,  the  role  of  FORUM  was  quite  specific  and  somewhat  limited. 

There  were  nine  active  participants  in  the  research  group  using  FORUM, 
and  tJiey  we;.e  divided  into  small  topic-oriented  groups.  Each  of  these  small 
groups  had  individual  concentrations,  but  there  was  also  a  strong  need  to 
keep  in  touch  with  the  activities  of  the  other  small  groups. 

FORUM,  still  in  the  early  testing  stages,  was  introduced  as  a  possible 
communications  aid  by  the  project  leader.  A  demonstration  of  FORUM  was  given 
to  the  research  staff  at  ISI  during  early  June.  This  demonstration  involved 
a  synchronous  conference  of  twelve  persons,  with  no  specific  topic  area  to 
be  discussed. 


This  was  probably  a  rather  poor  introduction  to  con%)Uter  conferencing 
(it  was  the  first  e35)erience  for  everyone  in  the  group) .  Several  key  factors 
contributed  to  a  general  disappointment  in  this  initial  exposure  to  FORUM  in 
a  synchronous  mode:  the  organization  problems  of  having  twelve  persons  on-line, 
the  newness  of  the  research  group  itself  (they  had  just  come  together  as  a 
group),  and  the  undeveloped  state  of  FORUM  at  that  time.  An  ur.fortunate  by¬ 
product  of  this  initial  test  was  a  tendency  to  generalize  from  r.his  single 
negative  experience  to  synchronous  computer  conferencing  in  general.  (Most 
of  the  group  never  tried  ar other  synchronous  conference — even  with  a  fjvaller 
groi^.)  The  noninteractive  ure  of  FORUM  which  developed  in  this  group  can 
perhaps  be  traced  in  part  to  this  initial  experience. 

The  use  of  FORUM  as  a  tool  in  the  actual  research  began  without  any 
detailed  strategy  about  the  role  it  would  have  in  the  group.  The  project 
leader  simply  began  leaving  messages  in  the  FORUM  program,  Gradually,  an 
agreement  was  made  for  each  of  Lhe  staff  to  check  FORUM  each  day  for  new 
information  and  add  their  own  comments.  From  this  point,  they  quickly  de¬ 
veloped  the  habit  of  entering  summaries  of  their  face-to-face  meetings. 

ever  the  period  of  time  described  here,  FORUM  became  an  important  part 
of  the  group  process.  The  style  of  usage  which  evolved  made  interaction  be¬ 
tween  groups  efficient  and  provided  transcripts  as  an  important  written  rec¬ 
ord  of  the  collective  thought  process. 

Tactics  (techniques)  of  FORUM  usage 

During  the  time  when  FORUM  was  being  used  by  the  Automatic  Programming 
Group,  other  media  of  communict\tion  were  also  being  used.  The  media  that 
can  be  identified  os  important  are: 

1.  Face-to-face  meetings  of  small  topic  groups  (usually  held  daily) 
and  of  the  entire  research  group. 

2.  FORUM  in  an  off-line  mode,  using  hard-copy  transcripts  of  the  in¬ 
formation  entered  into  the  system. 

3.  Informal  meetings  among  staff  (e.g.,  those  with  adjoining  offices). 

4.  Other  computer-based  media  such  as  messages  sent  through  SNDMSG, 
copies  of  documents  stored  in  TENEX  files,  etc.  (These  cannot 
presently  be  accessed  from  FCRUM,  though  this  will  soon  be  possible.) 

5.  FORUM  in  an  on-line  environment  using  Cathode  Ray  Tube  terminals 
(used  mostly  for  skimming  the  text  of  other  conferences  and  in¬ 
putting  reactions  to  hard-copy  transcripts) , 
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The  FORUM  discussions  were  used  primarily  to  store  and  distribute  working 
notes.  These  notes  consisted  primarily  of  siunmarized  thoughts,  notes  of  meet¬ 
ings,  synopses,  and  the  additions,  corrections,  and  comments  which  referred 
to  the  summaries.  The  notes  were  not  of  a  particularly  polished  nature,  but 
were  generally  the  "filtered"  results  of  longer,  more  intense  face-to-face 
meetings.  Occasionaily  a  new  or  rather  unrefined  idea  was  put  into  FORUM 
discussions  in  an  attenpt  to  receive  feedback  and  reactions.  This  feedback, 
however,  was  rarely  entered  into  a  FORUM  discussion. 

The  responses  that  were  put  into  FORUM  were  generally  triggered  on  a 
hard-copy  transcri^jt  of  the  discussions  which  were  created  as  special  com¬ 
puter  files  (in  TENEX) ,  edited,  run  off  in  multiple  copies,  and  distributed 
da..ly.  This  organization  and  distribution  of  hard-copy  transcripts  was  done 
by  a  very  competent  editc-..-secretary,  and  was  •' at  done  within  FORUM,  It  is 
our  plan,  however,  that  FORUM  will  gradually  adopt  much  more  of  this  editorial 
function  in  the  future. 

In  keeping  these  running  summaries  and  synopses,  the  records  were  detailed 
enough  to;  (1)  allow  communication  beti-’cen  groups;  (2)  allow  a  newcomer  to 
the  group  to  read  a  history  and  catch  up  on  the  research  status  of  the  entire 
group;  and  (3)  allow  the  various  grouj'S  to  create  reports,  papers,  and  more 
polished  summaries  of  the  work  conducted  during  the  period  which  FORUM  was 
used. 

General  reactions  to  computer  conferencing 

The  genera],  reactions  to  computer  conferencing  tended  to  be  positive, 
but  limited  to  structured  asynchronous  applications.  Most  participants  felt 
that  this  was  an  appropriate  limitation  and  that  computer  conferencing  would 
in  fact  be  most  beneficial  in  highly  structured  situations.  (It  should  be 
noted  that  synchronous  conferencing  was  not  attempted  by  the  group,  or  small 
groups,  after  the  initial  demonstration,  in  which  there  was  general  disap¬ 
pointment.) 

There  was  generally  a  negative  reaction  to  the  necessary  reliance  on 
typing  ability.  This  was  a  problem  for  five  of  the  nine  members  of  the  group 
and  may  have  affected  the  usage  of  FORUM  which  developed. 

The  comments  regarding  specific  characteristics  of  FORUM  seemed  partic¬ 
ularly  thoughtful  and  sometimes  imaginative.  Since  the  participants  were  all 
highly  skilled  computer  users,  it  is  perhaps  not  surprising  that  much  of  their 
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attention  was  focused  at  this  level.  In  general,  the  group  was  impressed 
with  the  simplicity  cuid  general  friendliness  of  FORUM.  However,  this  basi¬ 
cally  positive  rec-ction  van  tempered  by  numterous  suggestions  for  modifica¬ 
tions  of  the  structure  of  the  system.  Apparently  the  present  structure  was 
alluring  enough  to  whet  their  appetites  for  computer  conferencing,  but  left 
them  frustrated  at  certain  points. 

The  most  obvious  weak  point  \/as  the  unanimous  feeling  of  a  pressing  need 
for  at  least  basic  abilities  .n  text  editing  ana  review  of  conference  proceed¬ 
ings.  Suggestions  for  improvement  include  adding  the  ability  to  input  directly 
from  a  text  editor  outside  of  FORUM,  ai;..owing  persons  to  rewrite  and/or  add 
postscripts  to  their  own  earlier  comments,  allowing  comments  to  be  inserted 
into  previous  text,  abilities  to  search  the  text  according  to  various  criteria, 
and  other  suggestions  of  this  sort. 

One  of  the  more  provocative  suggestions  dealt  with  the  ability  to  alter 
existing  text  (specifically  to  change  one's  earlier  comments).  In  its  present 
form,  FORUM  has  an  implicit  reverence  for  comments  entered  by  an  individual. 
These  entries  are  indiscriminantly  frozen  in  the  formi  in  which  they  are  entered. 
Certainly  this  practice  has  a  real  value  if  one  wants  to  revcw  the  chrono¬ 
logical  develcpme-'t  of  a  conference.  Hov;cver,  in  other  cases,  this  might  place 
unnecessary  prerr':iuies  on  each  user.  (What  you  say  had  better  be  good,  because 
its  going  to  stay  three!)  The  ISI  pecple  suggest  that  some  flexibility  should 
be  considered  in  thii  .:agard. 

Group  dynamics  and  FORUM  usage 

The  research  group  at  ISI  was  formed  just  before  the  use  of  FORUM  was 
begun.  Six  of  the  nine  active  participants  were  graduate  students,  and  half 
of  those  graduate  students  were  there  fer  rnly  one  summer.  Only  basic  user 
profile  data  is  available,  though,  and  there  was  no  attempt  to  do  any  formal 
group  analyses  as  either  pre-  or  post-tests.  Thus,  we  can  only  relay  infor¬ 
mation  on  the  subjective  assessment  of  the  group  members  as  they  attempted  to 
sort  out  the  effects  which  FORUM  had  on  tlieir  research  team. 

Most  of  the  group  members  had  adjoining  offices  and  they  saw  each  otlier 
daily — usually  in  face-to-face  meetings  involving  the  research.  The  basic 
relationship  between  FORUM  and  these  face-to-face  meetings  is  discussed  in 
the  following  comments: 
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"The  main  issues  in  the  group  were  not  really  discussed  in  FORUM.  FORUM 
was  sort  of  the  key  that  started  the  interaction.  (It  showed  where  ideas 
were  coming  together  or  diverging.)  It  kept  people  out  of  everybody 
else's  hair.  We  were  able  to  work  independently.  1  think  we  got  about 
three  times  as  much  work  done  becavise  of  this.  But  it's  so  hard  to  know 
what  the  effect  of  FORUM  was  because  we  were  interacting  in  so  many  dif¬ 
ferent  ways  at  once." 

"In  general,  when  we  talked,  we  talked  face-to-face." 

"I  have  this  feeling  that  it  has  cut  the  face-to-face  communici^tion  (at 
least  for  me).  And  the  coitnuuni cation  is  still  quite  adequate." 

"Having  this  feature  [FORUM]  really  was  a  nice  addition  to  the  group  and 
I  think  it  kept  them  moving  pretty  well." 

Since  FORUM  was  rarely  used  as  an  interactive  medium,  its  effects  on 
group  dynamics  were  necessarily  indirect.  Distribution  of  the  hard-copy  tran¬ 
scripts  encouraged  this  noninteractive  style.  FORUM  still  had  an  effect,  but 
it  came  in  such  areas  as  the  following: 

"I  can't  think  of  einy  effects  on  the  group  which  actually  came  from  FORUM 
usage,  except  that  we  have  a.  good  transcript.  It  makes  writing  the  report 
much  easier." 

"One  of  the  uses  for  the  thing  [FORUM]  is  in  the  ability  to  catch  up  with 
the  progress  of  the  group  for  newcomers." 

"FORUM  structured  things  much  more  explicitly." 

"You  don't  get  the  personality  conflicts  in  FORUM  that  you  do  in  face- 
to-face  meetings . " 

"I  didn't  see  too  many  individual  things  going  into  FORUM  which  hadn't 
been  tested  out  in  face-to-face  meetings.  A  lot  of  what  went  into  FORUM 
was  well  filtered  by  individual  group  meetings.  Occasionally  somebody 
would  put  in  a  response,  but  the  things  which  were  put  in  were  usually 
hashed  out  in  group  meetings. 

The  style  of  FORUM  usage  will  always  affect  the  kind  of  group  process 
which  develops.  In  this  case,  ;he  note  pad  style  seemed  to  limit  the  direct 
effect  of  FORUM  on  the  group  process.  Since  very  little  direct  communication 
was  done  via  FORUM,  the  effects  were  revealed  more  in  the  area  of  group  per¬ 
formance  than  group  dynamics.  The  group  generally  felt  that  FORUM  had  increased 
their  productivity,  though  they  also  did  not  perceive  any  strong  impact  on 
group  interaction.  The  one  exception  to  this  observation  involved. effective 
communication  betvjcen  grc  ips,  which  all  felt  was  enhanced  by  FORUM. 
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III.  CURRENT  PLANS 

WHISPER  MODE 

The  FORUM  whisper  mode  introduces  a  new  dimension  in  the  activities 
of  a  conference  participant.  He  can  access  tlie  command  languay?  level  and 
use  the  resources  of  the  executive  while  engaged  in  a  discussion.  The 
design  for  this  mode  of  operation  has  been  completed  and  it  is  now  being 
implemented.  We  expect  to  direct  special  attention  to  the  problems  of  the 
interface  with  file  systems  outside  FORUM,  where  real  technical  difficulties 
arise . 

Private  messages  treinsmitted  through  the  whisper  mode  are  currently 
unnumbered.  This  makes  them  inaccessible  in  the  review  process  described 
below.  A  period  of  experimentation  is  required  before  we  can  examine 
the  inpact  of  this  iiiability  to  review  private  messages.  Anonymous  entries 
are  numbered,  and  it  may  be  that  this  same  rule  should  apply  to  private 
messages,  especially  if  FORUM  comes  to  be  used  extensively  as  a  mail  pro¬ 
cessor. 

REVIEW  MODE 

The  eibility  to  refer  back  to  previous  entries  in  the  course  of  a 
conference  is  an  essential  one,  especially  when  users  operate  CRT  terminals, 
where  the  life  of  the  information  is  quite  short.  We  have  designed  an 
approach  to  the  review  problem  that  takes  into  account  the  following  para¬ 
meters  : 

•  The  date  of  an  entry 

•  The  author  of  an  entry 

•  The  entry  number 
Given  a  review  criterion  like: 

Review  Lipinski,  Miller  in  50-75 

the  system  will  review  all  entries  between  #50  and  #75  inclusively  which  ■ 
were  made  by  Lipinski  and  Miller.  It  will  display  either  a  specified  number 
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of  lines  of  each  message  cr  the  full  text  of  each. 

OTHER  DEVELOPME^^TS 

A  more  sophisticated  use  of  tlie  conference  transcript  involves  the 
option  to  transfer  it  into  the  participant's  own  directory  as  a  file,  which 
would  then  be  available  for  processing  imder  TECO  or  another  text  editor. 

A  reverse  process  involves  the  introduction  of  a  prepared  statement 
or  other  text  into  the  transcript  of  a  conference,  either  asyncnronously 
or  in  the  course  of  a  "live**  discussion.  This  feature  will  be  triggered 
by  a  SUBMIT  command,  which  is  now  being  designed. 

In  addition  to  these  refinements  in  the  use  of  text,  attention  is  now 
jceing  given  to  the  dynamics  of  conferencing  in  a  more  bas: c  sense.  We  do 
nr_  feel  that  our  experience  to  date  enables  us  to  have  a  strong  grasp  of 
an  overall  structure  in  which  the  various  conference  modes  could  all  be 
smoothly  related.  We  need  to  pursue  a  development  progra.1  to  clarify  the 
roles  of  the  substcintive  chairman  and  the  editor,  and  to  -’erstand  the 
ob.'tacles  which  the  participant  perceives  when  he  tries  to  comnunicate 
with  a  grc  iip  of  his  peers  through  a  computer  conferencing  system. 
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1.  STRATEGY  FOR  FORUM  USAGE 


"We  have  been  using  FORUM  to  mcike  working  notes." 

"Our  experiences  have  been  vague;  as  a  group  our  topic  wcis  vague,  and  that 
tended  to  make  things  even  harder  to  follow." 

"The  particular  thing  that  we  were  talking  about  was  very  unstructured.  The 
topic  was  the  wrong  thing  for  this." 

"liie  work  here  is  generally  very  exploratory  and  ill-defined,  llierefore, 
there  is  usually  a  very  large  volume  of  communication.  That  is  why  FORUM 
was  used  to  communicate  what  wf  did  each  day.  Also,  ttjat  use  is  partly  a 
function  of  the  fact  that  typing  is  a  rj-al  drag.  Also  it  is  a  function  of 
how  much  thought  of  that  type  you  are  willing  to  commit  to  paper. " 

"Our  group  used  FORUM  precisely  as  a  progress  report  medium.  That  worked 
very,  very  well. " 

"Thera  weren't  many  of  the  'Yes,  the  answer  is  4’  kind  of  message." 

"If  we  would  have  been  close  together,  it  would  have  been  silly  not  to  have 
face-to-face  meetings.  If  we  were  aroimd  the  country,  we  could  have  put  in 
position  papers  and  eventually  come  up  with  a  group  decision." 

"FORUM  is  clearly  going  to  lose  if  people  have  the  option  of  getting  to¬ 
gether  and  talking.  It  will  also  be  more  useful  \/here  people  know  what  they 
want  to  talk  about. " 
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2.  TACTICS  FOR  FORVM  USAGE 


"We  at  least  tried  to  put  out  the  ideas  coherently  in  FORUM  and  throw  them 
out  for  some  kind  of  interaction. " 

"We  could  refer  to  FORUM  for  detciils,  but  the  face-to-face  meetings  were 
used  for  the  really  funi .cimental  questions  which  really  needed  to  be  hashed 
out  in  real  time.  There  was  a  lot  of  personality  dynamics  going  cn  in  these 
meetings — a  lot  of  shouting,  v^ich  you  can't  do  in  FORUM  (can't  go  into 
'shout  mode*  and  print  out  in  blinking  capital  letters'." 

"The  main  issues  in  the  group  were  not  really  discussed  in  FORUM.  FORUM  was 
sort  of  the  key  that  started  the  interaction.  (It  showed  where  ideas  \-ieie 
coming  together  or  diverging.)  It  kept  people  out  of  everybody  else's  hair. 
We  were  able  to  work  quite  independently.  I  think  we  got  about  three  times 
as  much  work  done  because  of  this.  But  it's  so  hard  to  know  what  the  effect 
of  FORUM  v;as  because  we  were  interacting  in  so  many  different  ways  at  once." 

"I  didn't  see  too  many  individual  things  going  into  FORUM  which  hadn't  been 
tested  out  in  face-to-face  meetings.  A  lot  of  what  went  into  FORUM  was 
well  filtered  by  individual  group  meetings.  Occasionally  somebody  would 
put  in  a  response,  but  the  things  which  were  put  in  were  usually  well  hashed 
out  in  group  meetings." 

"In  general,  when  we  talked  to  each  other,  we  talked  face-to-face." 

"One  of  the  uses  for  the  thing  is  in  the  ability  to  catch  up  v/ith  tine  prog¬ 
ress  of  the  group  for  nerf  :omers.  It  should  be  ordered  at  the  option  of  the 
chairman  or  eacli  indiviuuau.  Perhaps  each  person  should  have  the  option  of 
ordering  it  the  way  he  wants  to.  It  is  the  scissors/paste  kind  of  thing." 

\ 

"V/hen  I  was  scanning  the  interactions,  I  would  respond  to  about  one  of  every 
ton  that  was  displayed.  I  don't  respond  very  much." 

"I  would  read  everything  on  the  terminal,  but  if  I  wanted  to  reply  seriously 
3.  would  go  to  the  transcripts." 

"I  really  could  only  assimilate  vrtiat  was  coming  out  when  I  had  a  hard  copy." 

"I  would  road  the  hard  copy  and  say,  'What  bullshit'  and  run  to  the  terminal 
and  put  in  my  response.  Sometimes  I  responded  right  off  the  top  of  my  head." 

"Within  my  own  group  I  relied  only  on  tho  hard  copy  transcripts.  On  the 
other  hand,  I  spent  about  half  an  hour  a  day  reviewing  the  other  group 
sessions  on  the  terminal.  It  was  a  very  good  way  of  catering  up." 

"I  didn't  even  road  the  stuff  on  the  terminal.  In  all  fairness,  1  wonder 
how  much  tlio  fact  tliat  it  was  FORUM  and  was  on  the  computer  was  really  itn- 
ixsrtant  as  oj)poscd  to  just  writing  things  up  at  the  end  of  the  day.  Once 
you  start  getting  hard  copy,  you  don't  read  what's  in  the  machine.  When 
tl>o  indexing  feature  is  added,  this  might  be  different." 
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"I  think  it  is  a  fairly  nice  medium,  because  it  is  a  medium  in  which  we  felt 
fairly  free  to  put  out  half-baked  ideas.  Now,  if  we  were  sitting  around  a 
table.',  we  would  do  that,  too.  But  they  would  be  quarter-baked  then." 

"The  other  thing  I  tend  to  do  is  to  put  a  general  comment  into  FORUM  to  see 
what  feedback  occurs.  This  is  much  easier  to  do  with  FORUM." 

"Once,  one  of  the  members  of  the  grovp  used  FORUM  to  throw  out  a  new  idea 
vAiich  he  hadn't  really  thought  about  very  much.  Nobody  answered  him  in 
FORUM.  We  all  went  and  talked  about  it  in  a  meeting." 

"I  never  sent  a  private  message  and  I  never  received  any." 

"I  got  into  a  mode  using  FORUM  where  I  didn't  really  worry  about  being  veiry 
specific.  Because  I  couldn't  edit  a  lou,  I  would  tend  to  type  more  loosely 
than  I  would  for  a  polished  thing.  Sc>  that  was  probably  good  in  getting  me 
to  just  sit  down  and  r/pe  and  letting  ideas  flow." 

"FORUM  was  not  used  as  a  v;ay  of  generating  and  compromising  ideas.  The 
system  was  too  slow  for  that  purpose." 

"Wiere  was  no  on-line  responding  to  comments.  We  speci‘:ically  v;ere  not  in 
an  on-line  mode.  It  was  like  anything  else  I  v/rite;  I  take  some  notes  and 
then  type  it  in  after  that.  Except  for  a  few  conveniences,  the  same  process 
could  have  been  done  with  a  typewriter." 

"FORUM  material  was  v/ritten  up  by  people  who  ware  trying  co  write  it  reason¬ 
ably  well  and  not  just  spew  it  in.  With  a  moderate  amount  of  editing,  I  can 
write  this  part  of  the  report." 

"FORUiM  is  used  as  a  reference  material  and  doesn't  include  the  arguments 
involved  in  getting  to  a  particular  point.  Usually  just  one  person  actually 
enters  information  into  FORUM." 

"Only  the  good  stuff  got  into  FORUM.  FORUM  was  our  PR  face." 

"I  think  people  made  a  conscientious  effort  to  really  summarize  their  thoughts 
before  putting  them  into  70RUM.  After  we  had  a  meeting  in  the  afternoon, 
someone  could  type  in  a  sy.^opsis  of  the  meeting.  You  could  then  make  com¬ 
ments  immediately,  so  the  next  day  in  the  hard  copy  you  would  get  the  initial 
input — plus  whatever  comments  were  entered  about  the  working  summary." 

"The  use  for  the  AP  notes  was  super.  We  are  now  summiirizing  whi.  c  we  did  and 
it's  a  great  reference.  The  only  communication  between  the  groups  was  the 
FORUM  transcripts.  Everybody  had  to  at  least  make  their  thoughts  concrete 
enough  to  wite  do’wn." 

"The  first  experiment  with  all  of  us  on  at  once  was  a  disaster.  It  was 
really  terrible.  I  think  tliat  is  not  the  right  way  to  use  this  medium.  •  It 
was  just  everybody  talking  at  once.  Much  too  much  information.  Asynchronous 
usage  would  be  better." 
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sent  lots  of  cutcsy-pie  private  siessages.  .Occasionally  it  was  used 
genuinely  to  define  and  clarify  general  messages.  (A  disarming  aside— 
’I  really  don't  think  you're  full  of  baloney,  but  ...')  It  was  like  eu 
extra  kicker." 
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3A.  GENERAL  REACTIONS  TO  COMPUTER  CONFERENCING 


"Two  things  have  to  be  going  on  in  BX)RUM:  one  is  the  notes  kind  of  thing 
(store  and  forward) ,  and  the  other  thing  is  some  kind  of  summary  document. 
There  were  so  many  notes  collected  that  it  took  a  real  commitment  to  actu¬ 
ally  go  into  cinother  conference.  If  you  really  want  to  have  interaction, 
you  need  something  that  tells  people  what  the  salient  things  are  which  are 
going  on  in  the  group." 

"FORUM  itself  wasn't  that  involved  with  the  group,  but  I  still  feel  that  it 
was  a  worth;<hile  tool.  I'm  not  sure  I'd  like  to  unhave  FORUM.  I  mean  it's 
very  addictive;  it's  like  DWIM  at  BBN  that  corrects  spelling  errors.  It's 
something  that  you  could  live  witlicut  for  all  your  life,  but  after  having 
it  you  don't  want  to  unhave  it.  it's  really  nice  to  have  it  correct  your 
spelling  errors  euid  other  little  sillinesses.  It  means  that,  like  OTIM,  I 
think  tliere  is  a  lot  that  could  be  added;  I  like  it — just  give  me  more!  And 
that's  how  I  feel  about  FORfJM. " 

"The  use  for  the  AP  notes  was  super.  We  are  now  S'ommarizing  what  we  did  and 
it's  a  errcat  reference.  The  only  communication  between  the  groups  was  the 
FORUM  transcripts.  Everybody  had  to  at  least  make  their  thoughts  concrete 
enough  to  write  down." 

"I  have  this  feeling  that  it  has  cut  the  face-to-face  communication  (at 
least  for  mo).  And  the  communication  is  still  quite  adequate." 

"It's  easier  to  drop  topics  in  face-to-face  meetings.  Somehow  topics  seem 
to  go  on  forever  in  ITORUM,  (Long  after  they  are  irrelevant.)" 

"The  system  is  extremely  useful  for  the  things  that  it  fits.  For  real  idea 
generating,  it's  too  slow.  For  both  history  and  long-term  thinking  (I  don't 
know  exactly  what  the  difference  is  between  long  cind  short  term  thinking)  , 
it  is  very  good.  (FORUM  is  good  for  'slow  thinking'.)" 

"FORUM  allowed  interaction,  but  it  didn't  force  it.  In  face-to-face  there 
was  more  demcind  for  a  response.  You  had  the  ability  to  time  the  interaction 
which  you  wanted  to  explore  when  you  v/anted  to  do  it." 

"I  think  it  will  be  much  more  successful  using  it  in  asyndironous  mode  than 
vaen  we  all  tried  to  get  on  the  system  at  once." 

"T  really  appreciated  the  fact  that  now  at  the  end  of  the  summer  we  have  a 
good  basis  of  written  material." 

"I  am  skeptical  of  using  it  synchronously  because  of  the  organizational 
problems . " 

"I  looked  at  the  transcript  of  the  synchronous  conference  (I  wasn't  in  it) 
and  it  seemed  that  they  were  more  interested  in  playing  witli  tlie  system 
than  actually  dealing  with  a  topic." 


"Our  experience  doesn't  really  test  the  conversations  mode.  Our  one  crack 
at  that  isn't  really  a  fair  test." 

"If  you  have  a  conference  on  a  more  concrete  topic  (more  directi'd)  ,  you'll 
find  a  kind  of  different  use  of  the  system.  Our  topic  was  just  not  focused 
as  a  team. " 

"It'i.  kind  of  a  funny  mediiim.  It  has  some  uses:  as  a  working  history,  as  a 
way  of  oetting  a  longer-term  discussion  down  in  hard  copy,  it  is  very  good. 

It  has  disadvantages — that  working  copy  is,  like  any  vrorking  copy,  very  con¬ 
fused.  " 

"It  \;as  hard  to  move  right  into  that  new  environment.  It's  a  ne./  medium  and 
conversing  in  that  mode  is  just  strange." 

"In  the  conversational  mode,  you  ai.e  using  it  as  a  substitute  for  talking. 

I'm  not  sure  that  will  ever  work,  but  even  if  it  does,  that  is  a  lot  differ¬ 
ent  from  the  way  we  are  using  it  now. " 

'Actually  using  it  in  the  conversational  mode  would  take  a  good  deal  of 
acclimating — at  least  for  me.  Typing  with  two  fingers  is  a  handicap." 

"There  isn't  really  a  context  which  is  implicit  in  the  interaction  using 
FORUM,  such  ar  diere  is  a  context  which  can  be  assumed  in  face-to-face 
commun’ cation . " 

"Even  if  you  have  the  best  possible  indexing  capability,  there  will  only  be 
a  certain  amount  avail^^ble  on  the  screen.  Hard  copy  may  definitely  be 
necessary. " 

"There  is  an  intense  stimulating  brainstorming  thing  that  happens  in  face- 
to-face  meeting,  and  I'm  not  sure  that  can  happen  through  a  typewriter." 

"The  biggest  bummer  of  the  system  is  having  to  type,  because  typing  is  a 
bummer  for  half  the  people  around.  (The  half  that  took  Chemistry  II  instead 
of  Typing. ) " 

"It's  not  the  same  as  having  a  bunch  of  television/telepKones.  I  don't  think 
a  typewriter  serves  the  same  purpose.  If  you  want  to  have  a  conference  phone 
call,  then  you  have  a  conference  phone  call.  If  you  want  to  use  FORUM,  then 
you  use  FORUM.  I  don't  think  you  should  try  to  make  FORUM  be  a  conference 
telephone  ::all." 

"The  tine  .i-pcnt  typing  is  definitely  wasted  time.  It's  not  productive,  even 
if  you  are  a  good  typist." 

"FORUM  was  not  u 3od  as  a  way  of  generating  and  compromising  ideas.  The 
system  was  too  .'  low  for  that  purpose." 

"There  '.as  no  on-line  responding  to  comments.  We  .specifically  were  not  in 
an  on-line  mode.  It  was  like  anything  else  I  write;  I  take  some  notes  and 


then  type  it  in  after  that.  Except  for  a  few  conveniences,  the  same  process 
cou]i  have  been  done  with  a  typewriter." 

"The  other  th'ng  I  tend  to  do  is  to  put  a  general  comment  into  FORUM  to  see 
vAiat  feedback  occurs.  This  i-''  much  easier  to  do  with  FORUM." 

"Our  group  used  FORUM  precisely  as  a  progress  report  medium.  That  \/orked 
very,  very  well." 

"We  really  ha/en't  used  the  system  enough — that's  clear." 

"The  first  activity  had  three  threads  of  conversation  going  on.  When  we  went 
to  the  five  activities,  it  turns  out  that  in  general  the  same  thing  happens — 
each  one  has  at  least  three  different  conversations  going  on.  That  seems  to 
be  a  very  interesting  phenomenon. " 

"The  feedback  seems  to  be  an  important  difference.  In  talking,  you  get  im¬ 
mediate  feedback  eind  ycur  thoughts  change  very  rapidly.  I  tend  to  express 
things  very  differently  when  they  e  a  written.  Usually  in  talking  you  ex¬ 
press  half  an  idea;  in  writing,  you  have  to  express  the  full  idea." 

"FORUM  structures  things  much  more  explicitly.  The  option  to  pass  through 
other  people's  material  was  tliere,  but  you  could  work  within  your  own  group 
without  necessarily  processing  through  other  kinds  of  responses." 

"Certainry  it's  been  an  interesting  experience,  if  for  nothing  more  than 
improving  my  typing  ability." 

"I  think  it  is  a  fairly  nice  medium,  because  it  is  a  medium  in  which  we  felt 
fairly  free  to  put  out  half-baked  ideas  Now,  if  we  were  sitting  around  a 
table,  we  would  do  that,  too.  But  they  would  be  quarter-bciked  tlien." 

''In  any  research  group,  I  think  they  might  find  FORUM  useful.  It  needs  to 
sit  around  for  a  while;  that  is,  sit  around  here  and  be  available  and  see 
how  it  is  used.  This  is  one  use.  It  should  kick  aroiuid  at  a  few  different 
kinds  of  installations." 

"It  would  be  very  h,.ndy  for  a  programming  group  to  be  able  to  keep  things  in 
this  form  (using  FORUM) . " 

"I'd  like  to  try  a  class  where  most  of  the  class  was  run  with  FORUM." 

"I  would  use  FORUM  for  the  following  kinds  of  issues:  particular  answers  to 
pcirticular  questions,  anything  that  is  very  particular,  very  high  level 
things  that  I  just  wamt  people  to  notice  (in  a  hand  waving  sense) ,  the  inter¬ 
mediate  areas  where  there  is  a  general  discussion  area  vAiich  needs  to  be  de¬ 
fined  to  some  particulars." 

"The  ARPA  net  is  used  heavily  for  sending  mail  back  and  forth.  FORUM  could 
probably  add  to  this  ability." 


"If  w€i  could  have  been  close  together,  it  would  have  been  silly  not  to  have 
face-to-face  loeetings.  If  we  were  around  the  country,  we  could  have  put  in 
position  papers  and  eventually  come  up  with  a  group  decision c" 

"FORUM  is  clearly  going  to  lose  if  people  have  the  option  of  getting  together 
and  talking.  It  will  also  be  more  useful  where  people  know  what  they  want  to 
talk  edx>ut." 
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3B.  GENERAL  REACTIONS  TO  ,  ORUM 


"I  don't  think  the  subgroups  could  have  worked  interactively  within  FORUK. 

It  is  too  slow.  There  is  no  black!  ocird.  It  would  be  too  detailed  and  things 
chan,ge  much  too  fast.  (The  problem  were  dealing  with  was  the  defining  of 
a  program  within  an  ill-defined  area.)" 

"It's  a  tool  that  uses  paper,  and  part  of  Institute  philosophy  is  to  go  to  a 
paperless  system,  but  F0RU>5  doesn't  seem  to  work  very  well  paperless.  I 
liked  being  able  to  go  to  it  before  I  had  the  printouts.  But  I  also  like 
having  the  hard  copy  as  a  reference." 

"The  first  experiment  with  all  of  us  on  at  once  was  a  disaster.  It  was 
really  terrible.  I  think  that  it  is  not  the  right  way  to  use  this  medium. 

It  was  just  everybody  talking  at  once.  Much  too  much  information.  Asyn¬ 
chronous  usage  would  be  better." 

"CRT  is  better  than  a  hard  copy  terminal  if  you  can  have  hard  copy.  The 
perfect  system  is  to  have  CRTs  and  a  good  secretary." 

"Eventually  the  AP  project  is  going  to  have  programming  needs.  Wliat  you 
would  like  to  do  is  get  access  to  those  files  from  within  IX3RUM." 

"CSaviously  a  multi -screen  terminal  would  be  nice;  especially  if  you  have 
several  conferences  going  at  once.  It's  a  little  tiring  watching  things  go 
off  the  top.  I'd  like  to  have  it  like  the  screens  over  hospital  beds,  where 
you  could  take  the  readings  of  various  groups  and  respond  as  a  need  occurred." 

"I  didn't  even  read  the  stuff  on  the  terminal.  In  all  feurness,  I  wonder 
hov7  mud)  the  fact  that  it  was  FORUM  and  was  on  the  computer  was  really  im¬ 
portant  as  opposed  to  just  writing  things  up  at  tlie  end  of  the  day.  Once 
you  start  getting  hard  copy,  you  don’t  read  what's  in  the  machine,  lihen 
the  indexing  feature  is  added,  this  might  be  different." 

"Recently  someone  in  Conference  3  put  in  a  little  story  which  he  had  refer¬ 
ence  to  in  some  other  writings.  It  was  thrown  out  for  stimuli  and  l  reacted 
to  it  right  now.  I  wanted  to  get  back  to  them  that  I  thought  the  whole 
goddam  thing  was  presurnptious.  I  mean  it  was  a  nice  point;  it  was  just 
poorly  made," 

"Another  thing  that  seemed  to  be  wrong  was  that  when  you  Ccime  back  in  and 
it  asked  you  how  many  messages  you  wanted  to  see,  usually  it  showed  you  the 
wrong  number,  or  some  other  confusion.  One  time  I  just  couldn't  get  it  to 
not  show  me  everything,  and  I  did  not  want  to  see  65  messages!" 

"We  really  haven't  used  the  system  enough — that's  clear." 

"I  would  really  like  to  see  some  dating  and  time  of  messages." 

"I  try  to  go  back  and  tap  into  the  same  drummer  I  was  listening  to  before 
when  I  had  v.’ritten  something  in." 
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"I  really  wovild  have  liked  it  if  the  numbering  was  sequential  and  you  didn't 
lose  a  number  if  you  canceled  a  test  entry." 

"I  would  also  like  the  ability  to  go  back  and  write  my  own  messages  again. 

I  realize  this  is  a  question  of  philosophy  which  you  may  have  already  decided 
about,  but  this  is  ny  opinion." 

"There’s  a  lot  of  garbage  messages  in  there.  That’s  why  we  have  a  lot  of 
messages  which  end  mid-sentence,  followed  by  ’Oops’.’’ 

"It  seems  to  me  that  often  somebody  will  make  some  comment  which  will  re¬ 
ceive  all  kinds  of  replies,  and  he  will  go  back  and  decide  that  it  was  simply 
badly  phrased.  Therefore  he  goes  back  and  adds  a  postscript  so  that  the 
other  people  in  the  conference  won’t  be  misled." 

"The  option  of  adding  a  postscript  is  a  sure  thing;  whether  you  want  the 
option  of  rewriting  is  another  question.  I  think  you  should  have  the  option 
for  both.  ’’ 

"The  linear  transcript  is  not  very  entertaining.  There  are  coo  many  con¬ 
fusing  threads." 

"When  really  trying  to  do  something  polished,  the  editing  facilities  were 
terrible.  I  would  have  liked  to  at  least  be  able  to  insert  a  file  that  I 
had  edited  outside  of  FORUM." 

"The  system  is  very  well  human  engineered.  I  can  say  that  again  and  again. 
It's  beautiful!  It’s  simple;  you  just  follow  the  instructions,  and  it  does 
all  of  the  right  things." 

"Reading  one  line  at  a  time  and  then  having  others  disappear  may  be  all  right 
for  reading  dime  novels  (that’s  what  the  speed  reading  people  tell  you  to  do) , 
but  it  doesn’t  work  for  technical  material." 

"I  wish  I  could  just  do  this  (making  wringing  motion  with  her  hands)  to 
FORUM.  I’d  like  to  be  able  to  tell  it  to  roll  front  and  roll  back.  Just 
roll  it  around  like  it  was  really  a  scroll.  It  would  ai so  be  nice  to  jump 
in  in  the  middle  or  just  advance  a  line  or  gc  back  a  line." 

"We  were  so  worried  about  system  crashes  and  that  sort  of  thing  that  we 
tended  to  write  shorter  messages." 

"You’ve  done  some  things  to  make  CRTs  very  nice.  TENEX  has  this  abominable 
thing  where  when  you  delete  a  character,  it  Xes  through  it,  which  is  patently 
cibsurd  on  a  CRT.  I  really  think  that  a  well  human  engineered  system  knows 
that  you  are  using  a  CRT.  TENEX  doesn’t  know  at  all;  FORUM  knows  a  little 
bit ,  but  it  could  know  more . " 

"We  really  suffered  ’^rom  not  being  able  to  get  back  and  forth  between 
messages.  Especially  not  even  being  able  to  get  our  own  messages  at  all'. 

There  was  no  way  to  step  into  the  print  option  and  add  or  respond." 


"The  system  is  just  beautifully  simple.  It  is  .very  well  done.  I  nay  be 
biased  because  it  looks  so  good  on  a  CRT." 

"A  lot  of  people  went  into  command  mode  in  the  middle  of  a  message  and  lost 
the  message." 

"Hie  ability  to  insert  dynamical ly—if  I  can  get  an  idea  in  an  appropriate 
sequence,  it  seems  to  me  there  is  a  win." 

"Two  things  have  to  be  going  on  in  FORUM;  one  is  the  notes  kind  of  tning 
(store  and  forward) ,  and  the  other  thing  is  some  kind  of  summary  document. 
There  were  so  many  notes  collected  that  it  took  a  real  commitment  to  actu¬ 
ally  go  into  another  conference.  If  you  really  want  to  have  interaction, 
you  need  something  that  tells  people  what  the  salient  things  are  which  are 
going  on  in  the  group." 

"In  using  it  as  an  on-line  .recorder  of  events  (when  not  expecting  any  real 
time  response) ,  firstly,  I  would  like  very  much  to  be  able  to  edit  before 
actually  inputting  the  information.  The  only  solution  is  to  have  access  to 
a  full-scale  text  editor." 

"The  thing  needs  to  be  my  friend.  My  fr..end  wouldn't  walk  in  here  tind  throw 
a  mirror  up  to  me.  I  need  a  shave!  I've  got  things  in  there  that  I'm  trying 
to  type  in  as  fast  as  I  can;  I  don't  want  tlaat  thing  sitting  there  under  my 
name  later  on  if  I  know  it's  going  to.  If  I'm  in  a  petty  little  research 
environment,  I'm  constrained  and  you're  putting  pressiires  on  me  tliat  I  don't 
want.  I've  made  my  goofs,  and  I'll  go  back  and  rework  it,  and  say  that's 
not  what  I  meant-“that' s  not  what  I  meant  at  all." 

"Chronological  ordering  of  comments  is  a  very  secondary  thing.  There  should 
be  some  xind  of  dynamic  sorting  ability — that  is  most  important." 

"One  of  the  things  i  found  myself  using  a  great  deal  was  the  print  option, 
but  it  is  a  pain.  It  is  pure  unadulterated  hard  work.  I  can  act  off  of  a 
series  of  old  dialogue  as  if  it  were  new  dialogue,  and  I  can  get  new  stimuli 
and  v/ant  to  respond.  But  the  ideas  go  right  out  of  my  head  when  I  can't  re¬ 
cord  them  on  my  screen  as  they  go  by.  The  purpose  of  the  thing  is  to  find 
me,  stimulate  me,  and  find  out  where  my  head  is." 

"1  obviously  should  be  able  to  generate  a  list  of  the  conference  and  insert 
iueas  as  I  go  through  it  again.  I  want  i  macro  way  to  come  into  the  confer¬ 
ence  so  it  is  easy  to  keep  my  thought  in  my  head.  The  thing  it  provides  me 
with  is  an  answer  to  that  old  thing  about  'go  back  time  in  thy  flight,  I 
thought  of  the  comeback  I  needed  last  night'." 

"There  is  something  about  putting  ideas  in  and  then  having  them  edited  so 
they  look  pretty  and  are  readable.  Mi  wife  was  up  here  one  Sunday  evSjwc.g 
and  I  had  some  things  I  wanted  to  put  in,  and  she  typed  them  in  for  me. 

Then  I  asked  her  how  it  occurred — that  sentence  doesn't  make  sense!  Right! 
And  it  wasn't  her  fault.  I  had  written  it  out  and  it  was  interpretable,  at 
least  one  different  way  and  she  picked  out  what  was  a  reasoi«able  interpreta¬ 
tion  of  what  I  had  written  down.  But  I  couldn't  change  it!" 
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"Unless  you're  doing  some  kind  of  psychological  profile  on  me,  I  don't  think 
it  is  necessary  to  have  all  those  initial  comments  in  their  initial  form." 

"By  the  time  I  had  gone  through  that  entire  review  thing,  1  wasn't  sure  what 
I  had  in:ended  to  say  at  all." 

"My  philosophy  is  that  I  would  much  prefer  to  have  virtua31y  full  control 
over  vdiat  I  was  doing.  I  would  like  to  give  the  user  this . capacity  and 
trust  him  not  to  do  stupid  things." 

"I  got  into  a  mode  using  FORUM  vAiere  I  didn't  really  worry  about  being  very 
specific.  Because  I  couldn't  edit  .a  lot,  I  would  tend  to  type  more  loosely 
than  I  would  for  a  polished  thing.  So  that  was  probably  good  in  getting  me 
to  just  sit  down  and  type  and  letting  ideas  flow." 

"It  didn't  work  in  real  time.  We  expected  that." 
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4.  GROUP  PYNAt  ICS  AND  TtlRUM  USAGE 


"One  of  the  uses  for  the  thing  is  in  ^  -:J-ility  to  catch  up  with  the  prog¬ 
ress  of  the  group  for  newcomers.  It  shou.d  be  ordered  at  the  option  of  the 
chairman  or  each  individual.  Perhaps  each  person  should  have  the  option  of 
ordering  it  the  way  he  wants  to.  It  is  the  scissors/paste  kind  of  thing." 

"FORUM  structures  things  much  more  explicitly.  The  option  to  pass  through 
other  people's  material  was  there,  but  you  coaid  work  vdihin  your  own  group 
without  necessarily  processing  .j.rough  otl’e  :  k’nds  of  re  ipopses." 

"It  itfas  positive  in  the  sense  that  people  were  following  their  own  stiniuli; 
this  way  it  was  an  extension  of  a  letter  thing ,  ad  reducto,  ad  absurdum. 

'.anted  to  see  an  idea  trampled  into  the  ground  and  you  could  see  it 
happening. " 

"I  haven't  got  an  experimental  design  to  tell  how  our  group  was  affected 
by  using  FORUM.  Here's  where  the  errors  are  compounded:  the  group  was  new, 
we  don't  have  any  basis  for  comparison,  to  seprcate  contributions  from  the 
normal  maturation  of  the  group.  As  a  consaque  cci,  the  things  that  I  did 
observe  could  have  been  as  a  result  of  maturation  or  the  use  of  FORUM.  What 
the  system's  effect  on  group  interaction  is,  is  speculative.  I  did  observe 
that  ideas  became  more  developed  and  ccwmunication  became  much  more  facili¬ 
tated." 

"My  office  is  separated  from  the  rest  of  my  small  group.  (I  am  upstairs 
and  tiiey  liave  desks  in  the  same  office  downstairs.)  Since  all  the  others 
are  do'  '  in  essentially  the  same  offices,  they  can  very  easily  turn  to  the 
next  V'sk  and  start  talking.  Since  I  tun  upstairs,  I  tended  not  to  do  that. 

I  don'c  go  down  there  raucli  at  all.  I  found  that  FORUM  was  perfectly  adequate 
for  most  kinds  of  cocraunication  I  need  to  do.  If  it  wasn't  available,  I 
probably  would  have  had  to  spend  more  time  down  ii  their  offices." 

"I  have  this  feeling  that  it  has  cut  the  face-to-face  communication  at  least 
for  me.  And  the  communication  is  still  quite  adequate." 

"You  don't  get  the  personality  conflicts  in  FORUM  that  you  do  in  face-to-face 
meetings.  It  seems  like  the  face-to-face  conference  causes  a  lot  more  in¬ 
formation  back  cind  forth  than  the  FORUiM  sessions." 

"It's  easier  to  drop  topics  in  face-to-face  meetings.  Somehow  topics  seem 
to  go  on  forever  in  FORUM  (long  after  they  are  irrelevant)." 

"The  main  issues  in  the  group  'were  not  really  discussed  in  FORUM.  FORUM  was 
sort  of  the  key  that  started  the  interaction.  (It  showed  where  ideas  were 
coming  togetlier  or  diverging.)  It  kept  people  out  of  o”-»rvbody  else's  harr. 
We  were  able  to  work  quite  independently.  I  think  we  got  aiout  three  times 
as  much  work  done  because  of  this.  But  it's  so  hard  to  know  what  the  effect 
of  FORUM  was  because  we  were  interacting  in  so  many  different  ways  at  once." 


-36- 


"We  could  refer  to  FORUM  for  details,  but  the  face-to-face  meetings  were 
used  for  the  really  fundamental  questions  which  really  needed  to  be  hashed 
out  in  real  time.  There  was  a  lot  of  personality  dynamics  going  on  in  these 
meetings--a  lot  of  shouting,  which  you  Ccui't  do  in  FORUM  (can.'t  go  into 
'shout  mode'  and  print  out  in  blinking  capital  letters)." 


"We  had  ..11  just  started  working  together  and  we  didn't  know  each  other.  We 
were  all  new  here  emd  it  was  a  new  environment.  You  could  see  in  the  tran¬ 
script  tliat  there  was  trouble  with  the  ncunes  even." 


"I  am  skeptical  of  using  it  synchronously  because  of  the  organizational 
problems." 


"I  can't  think  of  any  affects  on  the  group  which  actually  came  from  FORUM 
usai^e,  except  that  we  have  a  good  transcript.  It  makes  writing  the  report 
much  easier." 


"Having  this  feature  (FORUM)  really  was  a  nice  addition  to  the  groups  and  I 
think  it  kept  them  moving  pretty  well." 


"FORUM  itself  v/asn't  tnat  involved  with  tlie  group,  but  I  still  feel  that  it 
was  a  worthwhile  tool,  I'm  not  sure  I'd  like  to  unhave  FORUM.  I  mean  it's 
very  addictive;  it's  like  DWIM  at  BBN  that  corrects  spelling  errors.  It's 
something  that  you  could  live  without  for  all  your  life,  but  after  having  it 
you  don't  want  to  unhave  it.  It's  really  nice  to  have  it  correct  your  speDing 
errors  and  other  little  sillinesses.  It  meeuis  that,  like  WIM,  I  think  there 
is  a  lot  tliat  could  bo  added;  I  like  it — just  give  me  more!  And  tliat's  how 
I  feel  about  FORUM." 


"It  went  smoother  when  we  broke  it  up  into  groups.  The  level  of  transfer  of 
info  between  groups  fell  off,  but  the  groups  were  productive  within  them¬ 
selves.  " 


"Within  my  own  group,  I  only  relied  on  the  hard  copy  transcripts.  On  the 
other  hand,  I  spent  about  half  an  hour  a  day  reviewing  the  other  group  sessions 
on  the  terminal.  It  was  a  very  good  way  of  catching  up." 


"I  don't  think  the  subgroups  could  have  worked  interactively  within  FORUM.  It 
is  too  slcrw.  There  is  no  blackboard.  It  would  be  too  de.tailed  and  things 
change  much  too  fast.  (The  problem  we  were  dealing  with  was  the  definition  of 
a  program  v;ithin  an  ill-defined  areas.)" 


"The  stuff  talked  about  in  FORUM  was  much  more  productive.  V?hat  happened  was 
you  could  have  small  meetings,  and  then  type  into  FORUM  and  everybody  else 
could  see  it. " 


"I  dicui't  see  too  many  individual  things  going  into  FORUM  whiah  hadn't  been 
tested  out  in  face-to-face  meetings.  A  lot  of  what  went  into  FORUM  was  well 
filtered  by  individual  group  meetings.  Occasionally  somebody  wou.  d  put  in  a 
response,  but  the  things  which  were  put  in  were  usually  well  hashed  out  in 
group  mjotings." 


'In  general,  when  we  talked  to  each  other,  we  talked  face-to-face, 


